Active Domain Adaptation with Multi-level Contrastive Units for Semantic Segmentation

نویسندگان

چکیده

To further reduce the cost of semi-supervised domain adaptation (SSDA) labeling, a more effective way is to use active learning (AL) annotate selected subset with specific properties. However, tasks are always addressed in two interactive aspects: transfer and enhancement discrimination, which requires data be both uncertain under model diverse feature space. Contrary classification tasks, it usually challenging select pixels that contain above properties segmentation leading complex design pixel selection strategy. address such an issue, we propose novel Active Domain Adaptation scheme Multi-level Contrastive Units (ADA-MCU) for semantic image segmentation. A simple strategy followed construction multi-level contrastive units introduced optimize supervised learning. In practice, MCUs constructed from intra-image, cross-image, cross-domain levels by using labeled unlabeled pixels. At each level, define losses center-to-center pixel-to-pixel manners, aim jointly aligning category centers reducing outliers near decision boundaries. addition, also introduce categories correlation matrix implicitly describe relationship between categories, used adjust weights MCUs. Extensive experimental results on standard benchmarks show proposed method achieves competitive performance against state-of-the-art SSDA methods 50% fewer significantly outperforms large margin same level annotation cost. Code will https://github.com/haoz19/ADA-MCU .

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Unsupervised Domain Adaptation for Semantic Segmentation with GANs

Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe for tasks where acquiring hand labeled data is extremely hard and tedious. In this work, we focus on adapting the representations learned by segmentation netwo...

متن کامل

Semantic Segmentation via Multi-task, Multi-domain Learning

We present an approach that leverages multiple datasets possibly annotated using different classes to improve the semantic segmentation accuracy on each individual dataset. We propose a new selective loss function that can be integrated into deep networks to exploit training data coming from multiple datasets with possibly different tasks (e.g., different label-sets). We show how the gradient-r...

متن کامل

Target contrastive pessimistic risk for robust domain adaptation

In domain adaptation, classifiers with information from a source domain adapt to generalize to a target domain. However, an adaptive classifier can perform worse than a non-adaptive classifier due to invalid assumptions, increased sensitivity to estimation errors or model misspecification. Our goal is to develop a domain-adaptive classifier that is robust in the sense that it does not rely on r...

متن کامل

Sample-oriented Domain Adaptation for Image Classification

Image processing is a method to perform some operations on an image, in order to get an enhanced image or to extract some useful information from it. The conventional image processing algorithms cannot perform well in scenarios where the training images (source domain) that are used to learn the model have a different distribution with test images (target domain). Also, many real world applicat...

متن کامل

Learning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation

Semantic image segmentation is a fundamental task in image understanding. Per-pixel semantic labelling of an image benefits greatly from the ability to consider region consistency both locally and globally. However, many Fully Convolutional Network based methods do not impose such consistency, which may give rise to noisy and implausible predictions. We address this issue by proposing a dense m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2023

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-26293-7_27